Quantum-thermal annealing with cluster-flip algorithm 



Satoshi Morita,^ Sei Suzuki,^ and Tota Nakamura^ 

'international School for Advanced Studies (SISSA), Trieste 34151, Italy 
^Department of Physics and Mathematics, Aoyama Gakuin University, Fuchinobe, Sagamihara 229-8558, Japan 
'College of Engineering, Shibaura Institute of Technology, Minuma-ku, Saitama 330-8570, Japan 

A quantum-thermal annealing method using a cluster-flip algorithm is studied in the two- 
dimensional spin-glass model. The temperature (T) and the transverse field (F) are decreased 
simultaneously with the same rate along a linear path on the T-T plane. We found that the addi- 
tional pulse of the transverse field to the frozen local spins produces a good approximate solution 
with a low computational cost. 
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An optimization problem frequently appears in many 
situations of science and technology [1]. All known al- 
gorithms need an exponentially-long time to find the ex- 
act solution of non-deterministic polynomial problems. 
The traveling salesman problem, the satisfiability prob- 
lem, and the ground-state search problem of spin glasses 
are the typical examples. It is important to develop 
an efficient algorithm that provides an approximate so- 
lution with a reasonable computational time. A stan- 
dard method for such problems is the classical simulated- 
annealing method (CA), which was proposed based on 
an analogy between optimization problems and statisti- 
cal mechanics 0, 0] . The idea of CA is to identify the cost 
function to be minimized with the energy in a statistical- 
mechanical system. We perform a numerical simulation 
to obtain the equilibrium state of this system. The tem- 
perature is artificially introduced into the system and 
gradually decreased toward zero. The thermal fluctua- 
tions enable the system to escape from the local minima 
of the cost function. At low temperatures, the system 
may stay with a high probability in the optimal state. 

Quantum annealing (QA) is a novel algorithm pro- 
posed as an alternative of CA [1, H, i, 01- 

We use the 

quantum fluctuations instead of the thermal fluctuations. 
The quantum fluctuations are introduced by the addi- 
tional energy term that is non-commutative with the cost 
function of the optimization problem. In the Ising spin 
model, the transverse magnetic field (F) serves as this 
additional term. The additional term is initially set to 
take a large value so that the initial state is disordered 
by the quantum fluctuations. It is gradually decreased 
with time, and it finally vanishes. Only the cost function 
term remains in the final state. It is expected that QA 
can find an approximate solution more efficiently than 
CA because of the quantum tunneling between the local 
minima. Analytical [1, [1, and numerical 0, [HI 
investigations support this scenario. 

Although QA and CA have been studied a lot so far, 
hybrid methods of them have not attracted much at- 
tentions. Lee and Berne fT3| applied a method which 
carries out QA and CA alternately to the protein fold- 
ing problem. Battaglia et al. [l3| examined a similar 
method to the satisfiability problem. The present paper 




FIG. 1: Paths for three types of annealing method in the 
plane of the temperature and the transverse field. Note that, 
when the quantum Monte- Carlo method is applied to QA in 
practice, the QA path is lifted from the F-axis because a small 
but non-zero temperature is introduced. 



aims to investigate quantum-thermal annealing (QTA) 
that carries out QA and CA simultaneously. In par- 
ticular, we focus on the linear path on the transverse 
field (F) v.s. temperature (T) plane where these two pa- 
rameters are lowered with keeping /3F constant (Fig. [T]), 
where /3 = 1/T. To investigate QTA numerically in large 
systems, we used the path-integral Monte-Carlo method 
(PIMC) with the cluster-flip algorithm (the cluster-flip 
PIMC) [3, U^. There are two reasons why the cluster- 
flip PIMC is suitable for QTA: flrst, the cluster-flip PIMC 
can simulate any Ising-spin system in the transverse fleld 
without not only the error due to Suzuki- Trotter map- 
ping [l^ [l3| but also the slowdown of relaxation known 
as the Wiesler freezing [l_8i|. Second, the computational 
cost is independent of the temperature and the transverse 
field if keeping /3F constant. 

The performance of QTA by the cluster-flip PIMC (the 
cluster-QTA) is governed by the parameter (3T. The 
residual error is small but the computational cost be- 
comes larger when the value of /3F is large. To solve 
this dilemma, we introduce the local transverse-field pulse 
process. The main result of the present paper is that 
the cluster-QTA with the local pulse process exhibits the 
best performance in comparison among various anneal- 
ing methods with regard to the residual energy and the 
computational cost. 

Let us consider the transverse field Ising model defined 
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by the Hamiltonian, 
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where af (a = x, y, z) are the PauU matrices of the spin 
1/2 operator at a site i. The first term corresponds to 
the cost function of the optimization problem we want 
to solve. The quenched random interaction Jy follows 
the Gaussian distribution with the average zero and the 
variance one. We use, for the Monte-Carlo simulation, a 
single configuration of random couplings on the 100 x 100 
system with the periodic boundary condition. We con- 
firmed that the results given below are consistent with 
similar simulations with other random configurations on 
50 X 50 and 30 x 30 systems. The second term is the trans- 
verse field, which introduces the quantum fiuctuation to 
the system. 

In PIMC, the transverse field Ising model is mapped to 
the classical Ising model with an additional imaginary 

time dimension by the Suzuki- Trotter formula [l|_, 

[igj . The partition function at the inverse temperature /3 
is expressed as 
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where M is the length along the extra dimension (Trot- 
ter number) and S'|'"'' (= ±1) denotes a classical Ising 
spin at a site i on the mth Trotter slice. The boundary 
condition along the imaginary-time direction is periodic, 
i.e., ^I"*"''*'^'* = S^"^\ The nearest- neighbor interaction 
between adjacent Trotter slices. 
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is ferromagnetic. The mapped classical system is equiv- 
alent to the original quantum system in the limit of the 
infinite Trotter number. As far as the Trotter number is 
finite, the error of quantum-classical mapping appears. 
To suppress the error at low temperature, one has to 
choose a large Trotter number. When the Trotter number 
is large, the simulation suffers from the Wiesler freezing 
[l^ . where the spin-flip probability becomes very small 
and the spin state freezes in a practical computational 
time. 

The cluster-flip algorithm proposed in Refs. [3, [IBl 
solves the problems of the standard PIMC. The idea of 
the present algorithm is to make an update global in the 
imaginary-time direction and local in the real space. We 
create clusters only in the imaginary-time direction in the 
same manner as the Swendsen-Wang method [20|]. Each 
cluster is updated according to the local molecular-fleld 



from the neighboring sites. Since the correlated cluster 
in the imaginary-time direction is flipped by one update 
trial, the Wiesler freezing does not occur. Moreover, one 
can take the inflnite limit of the Trotter number by re- 
placing dynamics of clusters themselves to that of domain 
walls between clusters. It follows that the error of the 
Suzuki- Trotter mapping disappears. We can identify the 
spin states of the mapped classical system by the loca- 
tion of the domain walls and the spin state on the lowest 
Trotter slice. The computational cost of the cluster-flip 
PIMC is proportional to (3r, which is the average num- 
ber of domain walls in the imaginary-time direction at 
one site. This is contrasted with the standard single-flip 
PIMC where the computational cost is governed by the 
Trotter number M. 

In QTA, we employ the schedule of the transverse field 
given by 



Tit) = Toil ~t/T), 
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where Tq is the initial value and r is the annealing time. 
The Monte-Carlo step t moves from t ^ to t — t. 
We decrease the transverse field and the temperature si- 
multaneously while keeping (3T constant. Note that the 
convergence annealing schedule for QTA is the inverse- 
logarighmic law of the temperature and the transverse 
field [21|, which is slower than the power-law schedule 
for QA. However, the system surely converges to the de- 
sired optimal state in the infinite time limit. We also 
consider the standard annealing schedule of QA for com- 
parison, in which the transverse field is decreased as Eq. 
(HI with the temperature fixed at a sufficiently low value. 

The initial cluster states in QTA and QA are made 
by giving the position of domain walls by the Poisson 
process with the mean value PV. If the number of gen- 
erated domain walls, ridw, is odd, one of the domain 
walls is removed to obey the periodic boundary condi- 
tions along the imaginary-time direction. Since the ex- 
pectation value of is n^w/PT in the infinite limit of 
the Trotter number, the initial state corresponds to the 
all-up state along the x axis. 

Figured shows minimum residual energies of QTA and 
QA by the cluster-flip PIMC against the annealing time 
T. The minimum residual energy is defined by the differ- 
ence between the lowest energy in all the Trotter slices 
and the ground-state energy. The ground-state energy 
was obtained by the spin-glass server [2^. The parame- 
ters /3r for QTA and P for QA are set at /3r = /? = 20 
or f3T — (3 — 100. The initial value of the transverse 
field is chosen at Fq = 1 in all cases. Every simulation is 
repeated at least 100 times. 

As common to QTA and QA, when f3T or (3 is small, 
the residual energy rapidly decays for small t, while it is 
almost saturated for large t. The change in the residual 
energy curve from a rapid decay to a slow decay is under- 
stood as a crossover from the intrinsic curve of QA to the 
curve of QA with strong thermal disturbances [23|. The 
cluster-QTA with /3F = 100 preserves the large decay- 
rate longer than that with /3F = 20. Since the thermal 
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FIG. 2: (Color online) Annealing time r dependence of 
the minimum residual energy per site for a 100 x 100 two- 
dimensional Ising spin glass. The cluster-QTA is performed 
with /jr = 20 and 100. Correspondingly, the cluster-QA is 
done with /3 = 20 and 100. The broken curve with upper tri- 
angles is the data obtained by the cluster-QTA with the local 
pulse process performed with /3r = 10. The initial value of 
the transverse field is chosen to be To = 1 in all cases. Each 
annealing method is tried at least 100 times. 



fluctuation is less effective when PV is large, the rapid 
decay is attributed to QA at zero temperature. On the 
contrary, the thermal fluctuation begins to dominate the 
dynamics as r becomes large. The system finds itself at 
the finite temperature after the long Monte-Carlo steps. 
This is because the rate of non-adiabatic transition is sup- 
pressed and the excitation occurs due to very small but 
finite thermal fluctuations. We observed that the simi- 
lar crossover takes place also in the QA by the single-flip 
PIMC (see data of /? = M = 20 in Fig. [3]), as it has been 
recognizable in Fig. 1 of Ref . [ll| . 

For large r, after the crossover takes place, the final 
state of the cluster-QTA is a classical state in which no 
domain wall is present at all. Such a state loses the quan- 
tum fluctuations represented by ridw/Z^F. Once a spin 
falls into a classical state which minimizes the cost func- 
tion locally, it can hardly escape from the local minimum. 
Therefore, we introduce the local pulse process. 

The local pulse process is applied to a real-space site 
when there is no domain wall along the imaginary-time 
direction at this site. What is done in this process is to re- 
initialize the cluster state, so that it contains f3T domain 
walls on average as in the disordered initial state. The 
other sites are left untouched. This process is physically 
interpreted as an application of the on-site transverse- 
field pulse. The pulse process destroys classical states by 
creating domain walls and induces extra quantum fluc- 
tuations. It helps the spin state to escape from the local 
minimum. An increase in energy caused by this process 
is on the order of unity because it is applied locally. It 
is noted that every site always has at least two domain 
walls during the whole annealing process. However, this 



FIG. 3: (Color online) Comparison of the minimum residual 
energies per site obtained by the cluster-QTA, single-QA and 
CA. The abscissa is the computational cost (total cpu time) 
which is defined by the annealing time t multiplied by /SF for 
the cluster-QTA, r multiplied by M for the single-QA, and 
T for CA. The initial temperature for CA is To = 3 and the 
initial transverse field for the other methods is set Fq = 1. 



constraint does not matter for the spin-glass model we 
have investigated. Because of the global spin-flip sym- 
metry the final spin state is expected to contain both the 
ground state and its spin-flip state. For the system with- 
out the spin-flip symmetry, we might need to stop the 
pulse process at some time. 

The broken curve connecting upward triangles in Fig. [2] 
shows the performance of the cluster-QTA with the local 
pulse process. Even if we choose /3r — 10, the resid- 
ual energy continues to decay without the crossover. We 
found that the parameter (3T = 10 is almost optimal for 
the cluster-QTA with the pulse process. If /JF is larger 
than 10, a larger computational cost is needed to obtain 
the same residual energy. On the other hand, the smaller 
(3T causes insufficient quantum fluctuations which raise 
the residual energy. The additional cost of computation 
by the pulse process is only about the factor of 0.2 of 
the whole computational time. It is because the pulse 
process is not always applied and the re-initialization of 
the cluster state does not cost as much as the update. 

Figure [3] shows the residual energy against the com- 
putational cost. We performed not only the cluster-QTA 
but also CA and QA by the single-flip PIMC (single-QA) 
on the same sample. In CA, we chose a completely ran- 
dom spin configuration as an initial state and the temper- 
ature is decreased linearly from the initial value, Tq = 3, 
to zero. As for the single-QA, the initial spin configu- 
ration is completely random in the (2 -I- l)-dimensional 
space. The inverse temperature P is fixed to the Trotter 
number M according to Ref. [ll| , and the initial value of 
the transverse field is set at Fq = 1. These initial values 
for T and F are almost optimized so as to obtain the low- 
est residual energy. The residual energy in the single-QA 
is obtained from the lowest energy among all the Trotter 



4 



slices. The computational cost is defined by r multiplied 
by /3r for the cluster-QTA, r multiplied by M for the 
single-QA, and r for CA, which roughly correspond to 
the total cpu time. 

Apparently the decay rate of CA (solid curve) is slower 
than others. The single-QA and the cluster-QTA with 
and without the pulse process have similar decay rates. 
However, the cluster-QTA with the pulse process achieves 
the highest efficiency compared with other methods. It is 
clearly observed both in Figs. [5] and [3] that the crossover 
appears when a value of (iT or (3 is small. We consider 
that it appears much later in case when (3T is large. The 
crossover prevents us from obtaining a lower residual en- 
ergy. We must choose a large value of (JT in order to 
avoid the crossover. However, we must pay much com- 
putational cost in turn. The cluster-QTA with the local 
pulse process is the solution of this dilemma. We put the 
quantum fluctuations not to the whole system but only 
to the spin that is frozen earlier. This is the main rea- 
son why we can achieve the lower residual energy very 
efficiently. 

In conclusion, we investigated QTA implemented 
by the cluster-flip PIMC and revealed that the local 



transverse-field pulse improves the performance of QTA. 
In practice, we showed that QTA with the pulse process 
gives the best performance with respect to the residual 
energy and the computational cost, compared to CA, 
QA, and QTA without the pulse process. Although 
we have considered only the two-dimensional Ising spin- 
glass, it is noteworthy that QA by the single-flip method 
was reported not to be better than CA in a satisflability 
problem [l^. Whether QTA by the cluster-flip method 
works well in such a harder optimization problem is the 
future problem. 
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